Ankh3 is a protein language model based on the T5 architecture. It is pre - trained by jointly optimizing masked language modeling and sequence completion tasks, and is suitable for protein feature extraction and sequence analysis.
Protein Model
Transformers